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1. INTRODUCTION 

Extending control to the quantum domain, i.e., 
to physical systems whose behavior is not gov- 
erned by classical laws but dominated by quan- 
tum effects, has become an important area of 
research recently. It is also an essential prereq- 
uisite for the development of novel technologies 
such as quantum information processing, as well 
as new applications in quantum optics, quantum 
electronics, or quantum chemistry. Choreograph- 
ing the behavior of interacting quantum particles 
is a rather difhcult task in general, for a vari- 
ety of reasons, including the destructive effects 
of uncontrollable interactions with the environ- 
ment and measurement backaction, both of which 
lead to loss of coherence, for instance. Yet, many 
problems in quantum optics, quantum electronics, 
atomic physics, molecular chemistry, and quan- 
tum computing can be reduced to quantum state 
or process engineering, and optimization of ob- 
servables, which can be solved using Hamiltonian 
engineering techniques. In this paper we outline 
and compare different strategies for accomplishing 
this in various quantum settings. 



experience, i.e., control of systems that obey the 
laws of quantum physics using semi-classical sen- 
sors and actuators that interact with the quan- 
tum system but accept classical input (such as 
different settings of the classical control switches 
of the laboratory equipment) and return classical 
information (See Fig. 1). 

This model is applicable to many quantum control 
settings. For example, the quantum system could 
be an ensemble of molecules involved in a chemical 
reaction, subject to laser pulses produced by an 
actuator consisting of a laser source and pulse 
shaping equipment, and a detector that might 
consist of a mass spectrometer to identify the 
reaction products. It could be a solid-state system 
such as an ensemble of quantum dots representing 
qubits, with actuators and sensors consisting of 
control electrodes and single-electron transistors, 
respectively. It could be an ensemble of molecules 
with nuclear spins subject to actuators generating 
magnetic and radio- frequency fields, and sensors 
that detect the magnetization of the sample, etc. 



3. SYSTEM DYNAMICS 



2. CONTROL SYSTEM MODEL 

A control system must obviously consist of a sys- 
tem to be controlled and a controller. In quantum 
control the former is always quantum-mechanical. 
The latter can be either quantum or classical, and 
it may seem natural to choose another quantum 
system as the controller. Indeed, this is useful 
for some applications, for instance in quantum 
optics [Yanagisawa and Kimura (2003)]. The main 
challenge in general though, and the focus of 
this paper, is control at the interface between 
the quantum world and the classical world we 



In the setting defined above the state of the 
system can be represented either by a Hilbert 
space vector \^{t)), or more generally, a density 
operator p{t), i.e., a positive trace-one operator 
acting on the system's Hilbert space Ti.. Although 
the full Hilbert spaces of most quantum systems 
are hardly finite or separable — even the Hilbert 
space of the hydrogen atom is not separable if 
the full continuum of ionized states is included, 
we are usually only interested in controlling the 
dynamics of a finite-dimensional subspace of the 
system's full Hilbert space (e.g., a subset of bound 
states of an atom), and full control of an infinite- 
dimensional system is generally not possible in 
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Fig. 1. Semi-classical Quantum Control Model 

any case [see e.g. Tarn et al. (2000)]. We will 
therefore assume in this paper that the Hilbert 
spaces of interest are finite-dimensional, and thus 
all operators have matrix representations, etc. 

Neglecting decoherence and the effect of measure- 
ments for a moment, the evolution of the quan- 
tum system to be controlled is governed by the 
Schrodinger equation 

±\M,it)) = -^H[{{tmit)), (1) 

or the (equivalent) quantum Liouville equation 
d 
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where [A, B] = AB — BA is the commutator. 
% = h/2TT, where h is the Planck constant, but 
we will often choose units such that h — 1. Thus, 
the dynamics is determined by the Hamiltonian 
H[i{t)], which is an operator acting on the sys- 
tem's Hilbert space H, and depends on a set of 
(classical) control fields f{t) = if lit), ■ ■ ■ , fuit)) 
produced by the actuators. 

The main difference between Eqs (1) and (2) is 
that the former applies only to pure-state systems, 
while the latter applies equally to pure and mixed- 
state systems (quantum ensembles). Moreover, 
unlike the Schrodinger equation, the quantum Li- 
ouville equation can be generalized for systems 
subject to decoherence or weak measurements by 
adding (non-Hamiltonian) superoperators [opera- 
tors acting on Hilbert space operators such as p{t)] 
to account for the contributions of measurements 
and dissipation to the dynamics of the system 

p{t) - ChW)] + CmW)] + CdW)], (3) 

where ChW)] = -JilHW)], Pit)]- The main 
difference between Cm and £d is conceptual: the 
former depends on the measurements performed, 
i.e., the configuration of the sensors, which we 
can control, the latter on usually uncontrollable 
interactions of the system with the environment. 

Due to the physically prescribed evolution equa- 
tions for quantum systems, quantum control — at 



least in the classical controller model described — 
is fundamentally non-linear, even in the case of 
open-loop control. In the special case when the 
system's interaction with both sensors and the 
environment is negligible (which is obviously only 
possible for open- loop control), the system's dy- 
namics is completely determined by a Hamilto- 
nian operator H[f{t)\, and the main task of quan- 
tum control is to find effective ways to engineer 
this Hamiltonian to achieve a desired objective. 
For simplicity we will restrict our attention here 
mostly to Hamiltonian engineering in this case, 
although many of the techniques are still useful 
in the more there general case when the system 
is subject to measurements and/or uncontrollable 
interactions with the environment [Eq. (3)]. 



4. QUANTUM CONTROL OBJECTIVES 

Although the objectives vary depending on the 
application, most problems in quantum control 
can be reduced to quantum process engineering, 
quantum state engineering or optimization of ob- 
servables. The first, quantum process engineering, 
involves finding a Hamiltonian H[i{t)] such that 
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H[i{t)]dt 



(4) 



where J7 is a desired target process, and the sub- 
script -f- indicates that the exponential must be 
interpreted as a time-ordered exponential with 
positive time-ordering due to the time-dependent 
nature of the Hamiltonian. This problem is of par- 
ticular interest in quantum computing, where the 
target processes are quantum logic gates. In gen- 
eral, not every process can be implemented for a 
given system, and the set of reachable processes is 
determined by the dynamical Lie group associated 
with the set of Hamiltonians {H[i{t)] : i{t) e A}, 
where A is the set of admissible controls that can 
be produced by the actuators and satisfy physical 
constraints, e.g., on the field strength, etc. For 
example, for a Hamiltonian system a necessary 
(minimum) requirement is that U he a, unitary op- 
erator (acting on the system's Hilbert space), and 
other constraints may restrict the set of reachable 
operators further. However, if the target process 
is reachable then there are usually many Hamil- 
tonians, which will give rise to the same process. 

The second problem, quantum state engineering, 
requires finding a Hamiltonian iJ[f(t)] such that 
(a) l^itp)) = l^-i), l^ito)) = l^-o), and |*(t)) sat- 
isfies the dynamical equation (1), or (b) pitp) = 
Pi, pito) = Pq, and p{t) satisfies the dynamical 
equation (2) [or (3) in the general case], where po 
[l^'o)] and pi [l^'o)] represent the initial and target 
state, respectively. 



The final problem, optimization of observables, 

requires finding a Hamiltonian sucli tliat the ex- 
pectation value (or ensemble average) of an ob- 
servable A, Tr[Ap{tF)], assumes a maximum or 
minimum at a certain time tp, given that the state 
p{t) evolves according to Eq. (2) and satisfies an 
initial condition p{to) = Pq. Problems of this type 
arise frequently in atomic and molecular physics 
and chemistry, where the observables of interest 
can range from the position or momentum of a 
particle, to the dipolc moment or the vibrational 
energy of a molecular bond, etc., but they are also 
relevant in quantum computing where we wish to 
maximize the gate fidelity or the projection of the 
system onto subspaces that are robust with regard 
to decoherence, etc. 

While the second problem may appear much sim- 
pler than the first, it can be shown that for a 
generic quantum ensemble, i.e., a quantum en- 
semble described by a density operator p with 
a maximum number of distinct eigenvalues, the 
problems of quantum state and process engineer- 
ing are essentially equivalent, up to a usually un- 
observablc (and hence insignificant) global phase 
factor. Similarly, the third problem is equivalent 
to quantum process engineering if the initial state 
of the system is a generic quantum ensemble 
and the target observable is represented by an 
operator A with distinct eigenvalues (occurring 
with multiplicity 1). It should be noted, however, 
that this equivalence does not hold for pure-state 
systems, which are always represented by density 
operators of rank 1, and for which process engi- 
neering is in general a much harder problem than 
the others. [See e.g. Schirmer et al. (2002a)] 



5. HAMILTONIAN ENGINEERING 

Having shown how many problems in quantum 
control can be reduced to Hamiltonian engineer- 
ing problems, wc shall now consider various strate- 
gies for finding and implementing control Hamil- 
tonians for quantum systems, and their advan- 
tages and drawbacks. So far, we have not made 
any assumptions about the structure of the Hamil- 
tonian i?[f(f)] or the nature of the control fields 
f {t) applied, both of which depend on the specific 
physical systems considered. While we will try to 
avoid being too specific some additional assump- 
tions are necessary. 

We can always partition H[i{t)\ into a system 
part Hs, which describes the system's intrinsic 
dynamics and is independent of the controller, 
and a control part Hc[f{t)\. Although Hc[i{t)] 
can depend on the control functions fm{t) in a 
nonlinear fashion, in many situations assuming a 
linear dependence on the field components fm{t) 



M 



HcW)] = E fm{t)Hr. 



(5) 



m—1 



is a reasonably good approximation. Furthermore, 
while in some applications such as solid-state ar- 
chitectures with multiple control electrodes, there 
are naturally multiple independent fields, in many 
applications there is only a single effective control 
field such as the electromagnetic field induced by 
a laser pulse, a maser or radio-frequency field, 
for instance, and thus the control Hamiltonian 
simphfies further Hc[{{t)] = f{t)Hi. 

In the control-linear case (5), a necessary and 
sufficient condition for being able to engineer any 
(unitary) process up to a global phase factor is 
that the Lie algebra generated by iHs and iHm, 
m = 1,...,M is either u{N) or su{N), where 
N is the dimension of the relevant Hilbcrt space 
H [Albertini and D'Alessandro (2001); Schirmer 
et al. (2002b)]. As outlined in the previous section, 
this is also a necessary and sufficient condition 
for quantum state or observable controllability, at 
least for generic quantum ensembles and observ- 
ables. Most quantum systems can be shown to 
be controllable, but constructive control can be 
challenging. 



5.1 Geometric Control Techniques 

Given a set of (independent) control Hamiltonians 
Hm, m = 1,...,M, which is complete in that 
the iHjn generate the entire Lie algebra, the sim- 
plest general strategy we can pursue is to expand 
the (unitary) target process U into a product of 
elementary (complex) rotations exp{icHm) in a 
cyclic, iterating pattern 



K 



fe=l 



M 



Yl exp{ickmHm) 



(6) 



and determine the constants Ckm in the expansion 

using Lie group decomposition methods, from 
which we can derive suitable values for the field 
strengths f,nk and control pulse lengths tmk via 
the relation Cmk = /o™'° fmk(t)dt, which reduces 
to Cmk = frnktrnk for picccwisc Constant fields. 

If the Hm are orthogonal, i.e., Ti[HmHn] = 
const. Smn, there are well-developed geometric 
techniques to solve this type of problem. Explicit 
solutions have been developed especially for many 
problems involving spin— 1/2 particles, which are 
of interest in nuclear magnetic resonance (NMR) 
applications [e.g. D'Alessandro (2000)], and even 
constructive algorithms for the generation of ar- 
bitrary imitary operators on n-qubits via S'C/(2") 
decompositions have been proposed recently [Sa 
Earp and Pachos (2005)]. For non-qubit systems 
the problem is harder but some explicit decom- 
position algorithms for simple A^-level systems 



have also been proposed [e.g. Ramakrishna et al. 
(2000b)]. 

In practice, however, most physical systems are 
subject to internal system dynamics in addition to 
the control- induced dynamics. This leads to a drift 
term Hs, which is usually non-trivial and cannot 
be turned off. In principle, wo can include this 
term in the expansion (6) by replacing the control 
Hamiltonians Hm by Hs + Hm, for example. How- 
ever, even if the Hm are orthogonal, the new ef- 
fective Hamiltonians in the expansion are usually 
not, which significantly complicates the problem. 
Moreover, even if we find a decomposition for 
given a problem, it may not be physically realiz- 
able as the Ckm could bo nogativo. Since the con- 
trol coefficient corresponding to Hs is fixed {fs = 
1), implementing such a rotation would require 
lotting the system evolve for negative times, which 
is usually impossible (except possibly if the evo- 
lution of the system is periodic). Decomposition 
techniques for non-orthogonal Hamiltonians that 
take these constraints into account exist for SU{2) 
[Ramakrishna et al. (2000a)] but even in this sim- 
ple case the resulting pulse sequences arc much 
more complicated and for higher-dimensional sys- 
tems even the minimum number of pulses neces- 
sary to generate a given unitary transformation 
given non-orthogonal Hamiltonians is generally 
not known. 

The usual way to circumvent the problem of drift 

is by transforming to a rotating frame (RF) given 
by e-'*^"|n), where {jn) :n=l,...,N = dimH} 
is a basis of H consisting of eigenstates \n) of Hs 
with eigenvalues (energies) i?„, Hs\n) = En\n). 
Setting Us{t) = exp{—itHs) the dynamics in the 
rotating frame is governed by the new (interaction 
picture) Hamiltonian 

H'cim] = Us{t)''Hc[m]Us{t). (7) 

Thus we have transformed away the drift term 
but the previously time-independent Hamiltoni- 
ans Hm in the control-linear approximation are 
now time-dependent 

H'rnm] = Us{t)^HmUs{t). (8) 

Thus further approximations such as spectral de- 
composition of the control fields into a small num- 
ber of distinct frequency components are needed, 
e-g-, 

= X] ^nn'{t)cOs{uJnn't + (l)nn'), (9) 

n,n' >n 

where tOnn' = {En' — En)/h is the transition 
frequency between states \n') and | «), A„„/(t) are 
"amplitude functions" and 0„„' constant phases. 
If the system is strongly regular, Wnn' 7^ '^mm' un- 
less {n.n') = {m,m'), and the transition frequen- 
cies LOnn' /fi- arc well separated, then choosing con- 
trol fields of the form (9) with slowly varying am- 



plitude functions A„„/(t) compared to 27r/w„„', 
enables us to address individual transitions via 
frequency selective pulses, and assume the follow- 
ing decomposition of the control Hamiltonian 

H'c= fnn'{t)Us{t)^Hnn'Us{t) (10) 

where /„„'(t) = A„„/(t) cos (cj„„/t + (/)„„/). We can 
further decompose the fields into rotating and 
counter-rotating terms since 2cos(a;„„'t -|- ^) = 

g-Hi(a;„„,t+0) ^g-i(c^„„,t+0)^ Noting that Us{t) is 

diagonal with respect to the eigenbasis \n) with 
elements e~'*^", and making the rotating wave 
approximation (RWA), i.e., assuming that the 
pulses are sufficiently long that the contribution 
of the counter-rotating terms averages to zero, we 
obtain the simplified RWA control Hamiltonian 

JjRWA^ J2 nnn'{t)Hnn'{Kn') (H) 

n,n'>n 

where r2„„' = A„„/(t)d„„'/2?l, and Hnn'{4>nn') = 
Xnn' COS (j)nn' + Vnn' sin (/)„„/, d„„' being the tran- 
sition dipole moment and x„„/ = \n){n'\ + |r?/)(r7,|. 
Unn' = *(|'^)('^'| — Thus, the evolution of 

the system is now governed by a control Hamil- 
tonian that is drift-free with time-independent 
components Hnn' , as desired. 

The RF and RWA are ubiquitous in physics, and 
the RWA control Hamiltonian is the starting point 
for the design of control schemes using geometric 
techniques in many applications. As the deriva- 
tion showed, however, it involves several simplify- 
ing assumptions such as strong regularity of the 
system, control dynamics much slower than the 
intrinsic dynamics of the system (control pulses 
must be much longer than the oscillation periods 
2iT/uJnn' for (9) and RWA to make sense), and the 
negligibility of off-resonant excitation. In reality, 
there arc often further complications. E.g., for 
coupled spin systems one typically transforms into 
a multiply-rotating frame which leaves a residual 
drift term, which is usually neglected by assum- 
ing that the control pulses are sufficiently strong 
(hard) so that the inffuence of the drift term is 
negligible and the Hamiltonians can be assumed 
to be effectively orthogonal for the decomposition. 
Obviously, these assumptions are not always valid. 
[For an analysis of the validity of geometric control 
schemes for atomic and molecular systems see 
e.g. Schirmer et al. (2002a).] 

5.2 Optimal Strategies for Fast Control 

If we wish to achieve control on time-scales com- 
parable to the intrinsic dynamics of the system, 
or wish to control systems with too many or 
insufficiently distinct transition frequencies, as is 
the case for complex molecular systems in chem- 
istry for example, then a different approach is 



required. A promising alternative is to formulate 

the control problem in terms of optimization of 
an objective functional such as the distance from 
a target state or target process, the expectation 
value of an observable or the gate fidelity, subject 
to the constraint that the dynamical evolution 
equations (1), (2) or (3) be satisfied. 

A particularly flexible approach is to formulate 
the control problem as a variational problem by 
defining a functional J = A — V — C, which 
incorporates the objective A, the dynamical con- 
straints V and the costs C and depends on vari- 
ational trial functions, and to use variational cal- 
culus to find necessary and sufficient conditions 
for an cxtremum. For instance, a very popular 
choice in physical chemistry involves setting A = 
Tr[Ap{tF)], where ^ is a (Hermitian) operator 
representing the objective (e.g., A could be the 
projector |^')(^'| onto a target state 1^1/)), with a 
dynamical constraint functional given by 

tF 

1? = y Tr [A,{t) (p„ + C[p,{t)])] dt (12) 

where £[p^(t)] = CH[pv{t)]+CM[pv{t)]+CD[Pv{t)\ 
and /9„ (<) and [t) are variational trial functions 
for the state (density operator) and observable, 
respectively, and a cost term related to the control 
field energies 
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(13) 



to 



where are penalty weights. Setting the inde- 
pendent variations of J with regard to Ay , py and 
/to to 0, a necessary condition for J to have an ex- 
tremum, then leads to a set of coupled differential 
equations with mixed boundary conditions, the 
Euler-Langrange equations, which can be solved 
numerically to obtain a solution for the control 
fields fm{t) and the corresponding trajectories for 
the state p{t) and the observable A{t). 

The key advantages of this approach are that 
we can deal with complex (and even non-linear) 
control Hamiltonians (no RWA or other approxi- 
mations required), and arc in fact not limited to 
Hamiltonian systems at all, and a wide range of 
costs or trade-offs can be taken into account. A 
drawback is that the Euler-Lagrangc equations 
are almost always nontrivial and can only be 
solved using numerical techniques. However, effi- 
cient algorithms with good convergence properties 
exist for a large class of problems [see e.g. Maday 
and Turinici (2003)], and promising results have 
been obtained for various applications, especially 
laser control of molecular systems using ultra- 
fast (sub-picosecond) pulses, a regime well outside 
the realm of applicability for frequency-selective 
geometric control schemes. 



5.3 Robust Control through Adiabatic Passage 

On the opposite end of the spectrum are adi- 
abatic techniques. Rather than applying control 
fields to induce (fast) transitions between various 
states of the system by absorption or emission 
of field quanta (usually photons), adiabatic tech- 
niques rely on (slow) continuous deformation of 
the energy surfaces by strong, slowly varying con- 
trol fields, and adiabatic following of the system's 
state, making use of the eigenstate decomposition 
of the Hamiltonian 

JV 

Hm] = J2^n{mn{t)){^n{t)\. (14) 

For a Hamiltonian with a control-induced time- 
dependence the eigenvalues en{t) and correspond- 
ing eigenstates |^'„(t)) vary in time. The idea of 
adiabatic passage is that if we start in a partic- 
ular initial state |^'o), which will usually be an 
eigenstate of the system's intrinsic Hamiltonian 
Hs, and then slowly switch on and vary suit- 
able control fields f{t), then rather than inducing 
spontaneous transitions to other states, the state 
1^1/(4)) is going to remain an eigenstate of the 
Hamiltonian and follow the path determined by 
the control fields via Eq. (14). Adiabatic passage 
is the basis for many control schemes in atomic 
physics [Shore (1990)], most notably STIRAP. 

The simplest example is population transfer in a 

three-level A-system (sec Fig. 2) simultaneously 
driven by two fields fm{t) = Am{t) cos{u!mt) , 
m = 1,2, that resonantly exite the 1^2 and 
2^3 transitions, respectively. In this case the 
RWA Hamiltonian (11) simplifies to 
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(15) 



with f2m — dm,m+l A^/2n for 



1,2. Setting 



n = y^nf + nl and 9{t) = arctan[fli(t)/1^2(i)], 
it is easy to verify that the eigenstates of this 
Hamiltonian are |*±(t)) = f^i|l)±rj|2)-Kl72|3) for 
A± = ±f2, respectively, and |^'o(i)) = cos0(i)|l) — 
iim9{t)\3) for Aq = 0. Thus, if the system is 
initially in state |1), then applying control fields 
such that Q,i{t)/fl2{t) changes (sufficiently slowly) 
from at to to oc at tp, results in adiabatic 
passage of the system from state |1) = 1 4*0(0)) to 
|3) = |*o(^f)) as0{t) goes from to 7r/2. STIRAP 
is based on the realization that we can achieve 
this simply by applying two overlapping Gaussian 
pulses in a counter-intuitive sequence, i.e, so that 
r22(i) starts and ends before ili{t) as shown in 
Fig. 2. Since the upper level |2) is decoupled, i.e., 
not populated during this process, the transfer is 
robust against decay from the excited state, which 
is often a major limiting factor in the control of 




Fig. 2. STIRAP pulse sequence (top) for robust 
population transfer from state |1) to state |3) 
(bottom) for three-level A system (inset). 

atomic or molecular systems, although it must be 
noted that the scheme is sensitive with regard to 
other forms of decoherence etc. 

5.4 Learning Control via Closed-Loop Experiments 

A potential problem with all of the techniques 
described so far is their reliance on a model of 
the system. Unfortunately, such models are not 
always available, especially for complex systems. 
While improved techniques for quantum control 
system identification will hopefully eventually al- 
low us to overcome this problem, an alternative 
which has already been successfully demonstrated 
in the laboratory [see e.g. Pearson et al. (2001)] 
are experimental closed-loop learning techniques 
[Judson and Rabitz (1992)], which must not be 
confused with real-time quantum feedback con- 
trol [Wiseman (1994)]. While both schemes rely 
on (classical) information gained from measure- 
ments, the former involve repeated experiments 
on many copies of the system, while the latter rely 
on continuous observation of the same system via 
weak measurements (e.g. homodyne detection or 
passive photodetectors) . 

Closed-loop learning techniques essentially adap- 
tive, using feedback to guide an evolutionary pro- 
cess. There are many variations but the basic 
strategy is simple. We define an objective func- 
tional, usually called fitness function, and select 
initial set (population) of control fields. Each of 
these is then applied to an identical copy of the 
system, and the observable measured to determine 
the fitness of the field. Then a new generation 
of control fields is computed from a subset of 
(mostly) well-performing fields using a set of pre- 
defined rules for mutations and crossovers, and the 
experiments are repeated with the new generation 
of fields until we have arrived at a population of 
fields with a sufficiently high fitness. 

Although there are some disadvantages to this 
approach (requirement of many identical copies of 
the system or the ability to efhciently re-initialize 
the system in the same state after each experi- 
ment, need for high experimental duty cycles due 



to slow convergence, etc.), closed- loop learning 
techniques have proved useful in the laboratory 
for a wide range of systems, and incorporating 
feedback from such closed-loop learning experi- 
ments in some form is likely to be essential for 
quantum control to succeed in the laboratory. A 
particularly promising avenue may be adaptive 
system identification strategies based on feedback 
from closed-loop experiments. 
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